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1, INTRODUCTION 

One principle key in distributed real time embedded system design is scheduling. Indeed, strategies 
that take into account both algorithmic and architectural characteristics to realize an efficient mapping of 
tasks to processors are crucial. Furthermore, in distributed real time embedded systems, several often 
conflicting criteria must be taken into account. Bi-objective scheduling deals with real-world problems that 
involve two conflicting objectives [1, 2, 3, 4]. It is one of the most active research field in the context of 
distributed real-time systems. Particularly, the Makespan and the reliability have been dealt by 
several researches. 

Makespan and reliability are simultaneously optimized while scheduling a set of independent tasks 
on a set of heterogeneous processors [5]. The aim is to converge towards Pareto optimal set. In [6], authors 
propose a spatial allocation based algorithm that works according to two steps, each one optimizing one of 
the objectives. In [7], a hierarchical approach favoring reliability is adopted by first selecting processors 
maximizing the reliability and then choosing processor that minimizes the earliest start time. The work 
presented in [8] extends the list scheduling heuristic [9]. 

The pair (failure rate, execution time) is used as a basis for choosing the best pair (processor, task). 
In [10], Makespan and reliability are normalized and combined in a weighted cost function. Processor 
selection is based on cost function minimization. 

The authors of [4] propose a new heuristic for heterogeneous systems that simultaneously optimizes 
the Makespan and the reliability of an application. A weighted function guides solution choice. In addition, 
solutions are classified to allow the user adapting the function and then selecting the appropriate solution. 
The work in [11] presents a bi-objective scheduling heuristic where Makespan and reliability normalization is 
realized by a compromise function. This one selects for each operation the subset of processors such the 
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replication of this operation onto those processors maximizes the reliability and minimizes the run-time. A 
function parameter may be varied to favor one criterion. 

In [12], a framework for the bi-objective static multiprocessor scheduling problem considering the 
Makespan and the reliability is proposed. The global reliability of the system is considered. The Pareto curve 
is produced for a given instance allowing the user to choose giving advantage to either 
Makespan or reliability. 

In [13], is presented a bi-objective genetic algorithm in which a weighted sum approach is used to 
deal with the two objectives Reliability and Makespan. Work in [14] proposes and compares two algorithms 
MOGA and MOEP based on non-dominated ranking, for solving the bicriteria scheduling problem. In 
addition, a comparision is made with the weighted-sum based bi-objective approach. 

Our work concerns bi-objective scheduling in distributed real time embedded systems while 
makespan and reliability are the considered objectives. Two heuristics cooperate in a hierarchical way to 
generate solutions, while an adaptation module is used to achieve a best space exploration. 

The paper organization is as follows: In section 2, some assuptions concerning system models and 
objectives are presented. Section 3, recalls the multi-objective otimization and presents bicriteria scheduling 
as a bi-objective problem. In section 4, the proposed approach is described. Before concluding, section 5 
depicts some experimental results assessing our approach. 


2. INPUT ASSUMPTIONS 
In our work, some assumptions are considered (Section 2.1 and Section 2.2). 


2.1. System Description 

Distributed real-time embedded systems are composed of two principal parts, which are the software 
part (the application algorithm) and the hardware part (the distributed architecture). The specification of these 
systems involve describing the algorithm components (algorithm model), the architecture components 
(architecture model), and the execution characteristics of the algorithm onto the architecture 
(execution model). 

The application is modeled by a data flow graph, called algorithm graph and noted Alg. Each vertex 
is a task and each edge is a data dependency. 
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Figure 1A. Algorithm Graph Alg Figure 1B. Architecture Graph Arc 





A task of Alg can be either an external input/output task or a computation task. Tasks with no 
predecessor (resp. no successor) are the input interfaces (resp. output), handling the events produced by the 
sensors (resp. actuators). The inputs of a computation task must precede its outputs. 

Figure 1A is an example of an algorithm graph, with six tasks: I and I’ (resp. O) are inputs (resp. 
outputs) tasks, while A, B, and C are computation tasks. The data-dependencies between tasks are depicted 
by arrows. For instance the data-dependence AP>C can correspond to the sending of some arithmetic result 
computed by A and needed by C. 

The architecture is modeled by a graph, called architecture graph and noted Arc. Each vertex is a 
processor, and each edge is a communication link. Figure 1B gives an example of an architecture graph, with 
three processors PI, P2 and P3, and three communication links. 

An execution time Exe is defined for each pair (ti, pj); it represents the worst case execution time of 
the task ti on the processor pj, expressed in time units. Assuming that processors are heterogeneous, one task 
could have different execution times on different processors. When a given task cannot be executed on a 
given processor, the association is expressed by the value ”oo”. On the other hand, to each pair (di, lj), is 


Indonesian J Elec Eng & Comp Sci, Vol. 9, No. 3, March 2018 : 789 — 798 


Indonesian J Elec Eng & Comp Sci ISSN: 2502-4752 O 791 


associated a time that expresses the worst case transmission time of the data dependency di on the 
communication link lj. Furthermore, the intra-processor communication time is supposed to be 0 time unit. 
For instance, Exe for Alg and Arc of Figures 1A and 1B is given in Tables 1A and 1B. 


Table 1A. Execution Times Table 1B. Transmission Times 
I ii A B C O I 
IDB PEB il A B 
Pl wo 2 6 4 2 nl pa IP b FO APC PC 
P2 4 oO 12 Pe) 4 8 LIZ 3 2 4 3 1 5 
P3 3 fp} 9 6 3 L13 6 5 8 6 2 10 
L23 3 2 4 3 1 5 


Application and architecture modeling using graphs, is useful for objective definitions 
(subsection 2.2.). 


2.2. Makespan and Reliability Objectives 
The makespan or schedule length is the end execution time of the task that 1s completed last among 
all tasks. It is defined as follows: 


(1) 
M = mar {aa end (t;, DP; )} 


Pj tz€ Pj 


where, end (ti, pj) is the time at which task ti terminates its execution on processor pj. 

A function called schedule pressure, calculated from the graph algorithm, is proposed in [15], it is 
noted o” and is defined for each task ti ¢ T“” comp (n refering to the heuristic step and comp to the set of 
competitor tasks 1.e those not yet scheduled and whose predecessors are already scheduled) and each 
processor pj as follows: 


a (ti, pj) = Shost(ts.ps) a Sy” (2) 


where: 
5” best(tipj ): the earliest time at which task ti can start execution on processor pj; 
S-, : the latest start time from end of ti [15]; 


Furthermore, execution and transmission times have to considered, hence the following expression: 


(3) 


ae -(7) 
o\") (ti,p;) = best (ti,p; 


) + tere - tcomm + chal ' 
Schedule pression is used to select the best task which mimizises the length of the critical path. That 
means that schedule pression mimization implies schedule length one. Otherwise, both processors and 
communication links are subject to failures. According to the model proposed in [12] and considering the 
occurrence of failures following a Poisson law with a constant parameter A, the reliability of a processor P 

(respectively, a communication link L) during the duration d is: 
(4) 

Rel =e-*? 


The reliability of the task or data dependency X placed onto the hardware component C, with an 
execution time exe(X, C), is then defined as follows: 


ee (5) 


Because the reliability depends intrinsically on the duration of the tasks and communications, some 
technical difficulties raise when using both reliability and makespan as objectives [12]. 

So, rather than using the usual model of the reliability [16], we use the concept of GSFR (Global 
System Failure Rate) defined in [12], and noted A. The GSFR of a static schedule S, is computed as follows: 


Bi-objective Scheduling with Cooperating Heuristics for Embedded Real-time System (Kalla Hamoudi) 


792 0 ISSN: 2502-4752 


_ —log R(S) 


A(S)= U(S) with R(S)= I] R(0;,p;) and U(S)= >. Exe(0;, p;) (6) 


(0i,p;)ES (0i,pj)ES 


where U(S) is the total utilization of the hardware resources and R(S) its reliability. The GSFR is the 
failure rate per time unit of the obtained multiprocessor schedule, seen as if it were a single task scheduled 
onto a single processor. 


3. SCHEDULING AS A MULTI-OBJECTIVE PROBLEM 
A multi-objective problem is a problem whose resolution implies multiple objectives consideration. 
The general optimization problem is defined as follows [17]: 


Minimize f(x) = |fi(z), fo(r),--- fm (2)| 


subject to g;(z) <0 i=1,2,---k 
and Aj;(r)=0 j=1,2,---l 


where m is the number of objective functions, k is the number of inequality constraints and | is the 
number of equality constraints. x € E" is a design vector, also called decision vector, where n is the number 
of its independent variables xi. f(x) € E" is a vector of objective functions where:\ 


fi (x): E” — E! 


f,(x) are also called objective or criteria. Each point in the design space maps to a point in the 
objective space but the reverse may not to be true. 


ww A, the decision space ae Z, the objective space 
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Figure 2. Decision and Objective Spaces 


Evaluation of solutions is done by using the Pareto ’dominance’ (Pareto 1906). A potentially 
interesting solution is a solution such as improving one objective can’t be done without degrading at least 
another one. Such solutions constitute the Pareto optimal set. Each solution can be represented by its 
objective vector in a multi-dimensional space (Figure 2). 

Let z and z’ be two points of the objective space. Formally, the Pareto dominance on objective 
vectors is defined as: 


A point z is Pareto dominated by a point z’: 
Vie {1---m} z, < a and Jie {1---m} so that z, < x 


While the concept of dominance is related to objective space, the optimality concerns the 
decision space. 
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Pareto optimal solutions constitute what is called the Pareto optimal set while the corresponding 
objective vectors i.e those ones not dominated, are said to be on the Pareto front. The Neighborhood is 
another important concept in combinatorial optimization. It is defined as follows: 

“The neighborhood of a solution s € S is a subset of configurations or solutions of S that are 
directly reachable by a given transformation of s. It is noted V (s) and a solution s € V(s) is said to be a 
neighbor of s.” 

Particularly, from a given solution, various Neighborhood structures can be established according to 
various transformations while a transformation is defined as an application: 


V:S —+ P(S) 


where S is a Set of solutions and P(S) is a subset of S. Such a concept is useful in search space 
structuring and in defining the set of solutions that can be reached from a given solution through a series of 
transformations. 

In our work, scheduling is bi-objective and is therefore considered as a bi-objective optimization 
problem. Solutions in decision space are shedules each of them expressing both task assignment to processors 
and a given execution order. Each schedule (solution) can be evaluated in the objective space (Figure 3) 
defined by the considered objectives (subsection 2.2.). The first objective is Makespan (equation (1)) that is 
defined using the cost function named schedule pressure (equation (3)) while the second objective is GSFR 
(equation (6)). 


A & 


Le f(s) = (Makespan(s), GSFR(s)) 
Se with s: scheduling 
@ e 





M (Makespan) 


Figure 3. Objective Spaces 


Rather than a single solution, a set of solutions (schedules) {sl, s2, - - - } is generated. Each 
schedule si makes a compromise between the Makespan and the reliability and is expressed by f(si). 


4. THE PROPOSED BI-OBJECTIVE APPROACH 
Given an algorithm and a target architecture, we aim to produce schedules realizing compromises 
between two objectives by minimizing Makespan and maximizing reliability. 
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Figure 4. The Proposed Approach 
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4.1. Approach Principles 

Our approach is based on two scheduling heuristics with an adaptation module to improve solution 
exploration by extending the search space. The two heuristics cooperate while dealing alternatively with the 
two objectives: Makespan and reliability. We use hierarchical scheduling to minimize Makespan and to 
maximize reliability by optimizing one objective at a time, i.e, we transform one of objectives into a 
constraint, which allows the solving of the problem by optimizing the second objective under the constraint 
of the first one. 

As shown in Figure 4, the first heuristic ARB (Adaptive Reliability-based Bi-objective heuristic) has 
as inputs the algorithm Alg, the architecture Arc and a GSFR (reliability objective) value Ap as a constraint. 
ARB heuristic execution leads to a solution with two values : Marg and Aagpp. Like ARB, AMB (Adaptive 
Makespan-based Bi-objective heuristic) has as inputs the algorithm Alg, the architecture Arc and the solution 
produced by ARB heuristic. The Makespan value MARB, produced by ARB, is considered as a constraint in 
order to maximize reliability. The result is a schedule with two values: Mamp and A,ayp. Cooperation 
between our hierarchical heuristics leads to a set of solutions among which the optimal ones according to 
Pareto optimality are selected. 

In the case of too closest compromise values, we propose to introduce an adaptation module to 
search for neighbors. Note that the fuction f associating decision and objective spaces is not surjective. That 
means there can be a compromise value in objective space which is not associated with any solution 
(scheduling) in decision space. For this reason, the adaptation must operate on decision space by creating 
neighbors of a given schedule, this one (neighbor) having necessarely a compromise value in objective space. 


Permutation-based csFR fe 
Adaptation —_ 
closest 
° ° ° aA comacnitie 
e © values 
° ® compromise values 
° associated to § neighbors 





current scheduling 
scheduling neighbor 
already 


selected schedulings 
M (Makespan) 





Figure 5. Adaptation Module Figure 6. Solution Translation 


To adjust a current solution, the adaptation module (Fogure 5) is based on the neighborhood 
structure concept (subsection 3.). In this work, a permutation-based neighborhood structure is used; it is 
defined by the following transformation: 

V:S— P(S) such that: V schedule s € S 


V (s)= {s’ | s’ is a schedule associated to a given permutation of s} 


Figure 6 is an example of too closest compromise values f(s) (blue color) and f(s’) (pink color) in 
the objective space. In this case, the adaptation module has the role of extending the search space by applying 
permutations on s. This one could be replaced by one of its neighbors. By changing the starting constraint for 
cooperating heuristics and using the adaptation module, a range of solutions is obtained while the ones that 
suit current needs are selected. 


4.2. Scheduling Algorithms 
The heuristics ARB and AMB implementing the proposed solution are greedy list scheduling. 
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while 7 » # i do 


end whil 
if me ls t . ct the then call Adaptat nu lure: end if 


end 


They cooperate to deal alternatively with the makespan and the reliability objectives. The first 
heuristic is based on a cost function called schedule pressure (equation (3) in subsection 2.2.) to select the 
best task which minimizes the length of the critical path. The superscript number, in parentheses in both 
Algorithms ARB and AMB, refers to the heuristic step. 

Constrained by a starting constraint which is a GSFR value, ARB algorithm works as follows: 
¢ Initialization: two lists are used, 

TT comp: 18 the competitor task list knowing that a task is said to be competitor if it is not yet scheduled 

and all its predecessors are already scheduled; 

- T(O).chea: Scheduled task list which will constitute, in the end, final schedule. 
e Evaluation: step (1) calculates, for each competitor task its schedule pressure on each processor such the 
specified constraint (A) is satisfied. 
e Selection: this step (2) is a selection of the best pair (task, processor), thus the one minimizing 
schedule pressure. 
¢ Update: step (3) consists in one hand to add the chosen task to scheduled task list and in the other hand to 
remove the chosen task from competitor task list as well as all its successors such that predecessors of the 
latters are already scheduled. 

Steps 1, 2 and 3 of ARB algorithm are repeated until there are no more competitor tasks. The ARB 
result is a pair (Mapp, Aarp) representing Makespan and GSFR values. During its execution, ARB algorithm 
may refer to the adaptation module. In a similar manner but constrained by Makespan value produced by 
ARB algorithm, AMB algorithm aims to optimize this time reliability objective. AMB algorithm works as 
follows: 


AMB Alge rithm 
Input: Alg, Arc, Marp 
Output: Mame. \ameB 
Begin 
Initialise the lists of competitor and scheduled tasks: 
(0) 4) 
Tcomp := {t € T | pred(t) = 0}: 
(0) > ek 
thal a 0; 
_ while Tromp £0 do oe 
e Compute the GSFR for each task t; of Teomp on each processor p; such that M; < Mars: 
e schedule the pair (competitor task t, processor p) such that GSFR value is minimal: 
e Update the lists of competitor and scheduled tasks: 
(n) ._. m(n-1) . 
T sched — ead U {t}; 
(n+1) . (n) a(t) |amed (4) C Ti?) 1. 
a Teomp — {t} U{t' € suce(t) | pred(t’) CT." }; 
end while 
if produced compromise value is too closest to others then call Adaptation Procedure; end if 
end 


Like ARB, AMB may also refer to adaptation module if solution adjustment is necessary. ARB and 
AMB execution can be repeated as many times as the decision maker decides. In addition, the starting 
constraint can be modified to create a new process instance. As much for ARB as for AMB, in the case of too 
closest solutions (in objective space), the adaptation procedure could replace the current solution (in decision 
space) by one of its neighbors. 
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In our work, we propose permutation-based adaptation. It consists of generating schedules among 
which there could be a schedule from which the search will be restarted. Permutation application on s 
generates schedules that are neighbors of s. However, only schedules satisfying real time constraints are 
considered. A current schedule s is replaced by one of its neighbors if (1) this one is not yet selected and (11) 
its compromise value is not closest to those of already selected schedules and (111) among s neighbors, it is 
this which corresponds to the non-dominated compromise value in objective space. In the case of no 
neighbor satisfies the three conditions, s 1s saved as current solution. 


Adaptation Procedure 


Input: current schedule s, already selected schedules 

Output: New schedule sy 

Begin 
generate the set of schedules by applying permutations on s; 
select the subset Ps of schedules satisfying real time constraints; 
if 3 a schedule s, € Ps such that 


(i) s, is not yet selected 
and 
(ii) its compromise value is not closest to those of already selected schedules 
and 
(iii) among schedules € Ps, f(sx) is the non dominated one then 
S~ is considered as the new schedule sy; 
else 
s is saved as the new schedule sn 
end if 
end 


In this way, the search space is extended to the Neighborhood structure produced by permutations. As soos as 
a solution (schedule) satisfying the three conditions above is found, it is considered as the current schedule. 
Note that, such a schedule may not be found, in which case current schedule is saved. 


5. SIMULATIONS 

To evaluate our approach, we have applied the AMB and ARB heuristics to a set of random 
algorithm graphs and an architecture graph composed of 3, 4, and 5 processors. We use SynDEx to generate 
the complete set of algorithm graphs. SynDEx is a CAD tool for optimizing and implementing real-time 
embedded systems (http://www.syndex.org). It has been designed and developed in the INRIA Paris- 
Rocquencourt Research Center France. 

We vary two parameters: the number of task N=20, 40, 60, 80, 100, and the communication-to- 
computation ratio (CCR), defined as the average communication time divided by the average computation 
time, CCR=0.1, 1, 10. For each N, 100 graphs have been generated. 

The general objective of our simulations is to study the impact of N, P, and CCR on reliability and 
makespan introduced by AMB and ARB. We compare our heuristics with the heuristic proposed in [11], 
called RBSA (Reliable Bi-Criteria Scheduling Algorithm) and implemented in SynDEx. 

Table 2 shows the makespan and reliability results of executing heuristics on an Alg composed of 50 
tasks. ARB-AMB* is the heuristics ARB-AMB without adaptation module. 


Table 2. Makespan and Reliability Results for N=50 Tasks 


heuristics 
RBSA ARB-AMB* ARB-AMB 
execution | 644.72, 0.998297 616.51, 0.998539 616.51, 0.998539 


execution 2 644.72, 0.998297 608.76, 0.999029 608.76, 0.999029 
execution 3 644.72, 0.998297 608.76, 0.999029 599.70, 0.999312 





As shown in this table, thanks to the adaptation module, ARB-AMB approach gives interesting 
results and better than RBSA and ARB-AMB*. 

Figures 7A, 7B, 8A, 8B, 9A and 9B shows makespan and reliability variations. We can see from the 
results that our approach performs better than RBSA for all the datasets. 
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6. CONCLUSION 

We have proposed a new bi-objective scheduling approach producing automatically a static 
distributed schedule of a given application Alg on a given distributed architecture Arc. The aim of our 
approach is to optimize simultaneously two antagonist objectives: system’s run-time (Makespan) and 
reliability. Our approach is based on two cooperating heuristics each of them dealing with an objective. To 
allow better space exploration, we integrate an adaptation module. 

Adaptation is based on the neighborhood concept and is achieved by solution permutation. This 
allows, in the case of two closest compromise values, to operate on the decision space by generating 
neighbors. They are schedules among which may be a schedule that is selected in order to improve 
exploration. As our approach is Pareto-based, a set of compromising solutions (schedules) is produced 
allowing the designer to select those satisfying the current needs. Simulations results show that the proposed 
approach performs better than RBSA for all the datasets. 
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